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(54) Digital data watermarking 

(57) Digital watermarking of data, including image, 
video and audio data, is performed by repeatedly insert- 
ing the watermark into subregions or subimages of the 
data. Similarly, the watermark is repeatedly extracted 
from the subregions of the data. 
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The above prior art watermiark extraction methodpl^ 
ogy requires the original injage spectrum be subtract^-; 
from the watermark image spe^dm^^^ restricts the ~ 
use .pf tiie^rnethod when there^is no original image or 
origin^ "irtiage spebb*u^^^ One application 

where this presents a significant difficulty is tpr thijrd 
par^ device providers desiring to read ernbedB^ inlor-^^ 
mation for operation or denying ^Deration of sucH a"^' ~ 

^e^^Ce. ? ^^--n^^-^^C ru-r ^^^^^ : 

In US Patent No. 5.319.735 by R.D. Preuss et a! 
entitled "Embecfcled Signalling" digity infprnr^tiqn 
encoded to produce a sequence of code symbolis. The^ 
sekjuence^of 1^ an audipsig- ^ 

:nal by generating a corresporKling^equOTce of spread:^: 
spectrum code signals: repre«erTting'?the sequence of 4 
code symkjols. The frequency components of the cbdei 
signal beinjg ^entially confined to: a pri^el^cted sign^-i.^^ 
alin^ band lying withiri the tandwidth of the iujdidrsign^S . 
data form h^e a need to embed signals, jmo>,f ;. ^7 Wsu^ 

video/image/multimedia data wNch can: subsequently4^ 2a^... s^ code symfcote in the se^ 

be detected by software and or hardware devices fbrs^v^ :the audio signal is continuously frequency analyzed ^ 
purposes of authenticating copyright ownership, control over aj frequency band encompassing th^ sgn^lingh 
and management band arkl the code 



The present invention relates'to digital watermark- 
ing of data including image, video and multimedia data. 
Specifically, the invention relates to the insertion anU 
extraction of embedded signals for purpo^^ of vv^er-^ 
marking, in which the insertion and faction prixie- 
dures are repeatedly applied to subregions of the data. 
When these subregions correspond to the 8x8 pixel 
blocks used for MPEG and JPEG compression and 
decompression, the watermarking procedure can be 
tightly coupled with these compression algorithms ^o 
achieve very sighificaht savings In 

The proliferation of digitized media such as Image; 
video and multimedia is creating a need for a secUrity£^ 
system which facilitates the identification of tiie source.:^ . 
of the rnaterlal. _ rvi>vr^^t5;vv:;C^ ^i:i>t 

/ Content pro\^^ i.e: owners of wort© jn digiteln^^^^ 

embed signals into 



For example, a coded signal nrtigHt 6i insert^-ih^^ 
data to indicate tiiat the data should not be ccpiedi Theh^ 
ent)edded signal shoukJ preserve the lma# fidelity; bfie" ' 
rol)ust to common signal transformations and resistant 
to tampering. In addition, consideration must be given to 
the data rate tiiat can be provided by the system, 
though current requirements are relatively low - a few 
bits per franrie. 

f In EP-A:766 468' cx)rres^ U^: Parent 

y^plic^oaSerial Nd 08^4^894* fflkJ Sep^ 
1995. entitled "Secure :^read Spectrurn Watermarking 
for Multimedia Data" and _ a^^ to the same 
assignee as tie present invention, which is incorporated 
herein by reference, tiiere was proposed 5 spread spec- 
trum watermarking method ©nbeilded a yvater- 
mark signal imo perceptually: agnifK^rrt :r^ 
image for the purpbses of ideritifying thet cor^^^^ 
and/br possessor. A strength of this approach Is tiiat the 
watermark is very difficult ito rernwB. in feet this method 
only allows the watermark td bb read if tiie original 
image or data is available for comparison. This is 
because the original spectrum of tiie watermark, is 
shaped to that of the inniage through a non-linear multi- 
plicative procedure and this spectral shaping must be 
removed prior to detection by nriatched filtering and the 
watenmark islnsefted irito the N largest spectral coeffi- 
cients, tiie ranking of which is not preserved after water- 
marking. Thus, tiiis method does not allowr software and 
hardware devices to directiy read erT*>edded signals. 

In an article by Cox et aL. entitled " Secured Spec- 
trum Watermarking for f^ultimedia" available at 
http://www.neci.nj.com/tr/index.html (Technical Report 
No. 95-10) spread specti-um watermarking is described 
which embeds a pseudo-random noise sequence into 
the digital data for waternrrarking purposes. 
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function of the analysis to provide a modified code^g^ 
nal with frequency component levels which are. atea^"^ * 
?time instant essentially a presalec|ed jp^ro^ 
levels of the audio signal frequiincy'<x)mpdri 
responding frequency ranges. The modified code signal-- 
and the audio signal are combined Jto gro^^ 
ite audio signal in which' thV digrtal '^infofrra 
errtoedded.^ lhis rpon^nent ■ audiOn signal^ fe^^ 
recorded on a recordnng^mejdw^ is otherwise siib- 
jected to a transmis^^ 

tills procefe ,ara: Jre;. isf^^ df»aping: auid sp^^ 
equalization that occur at the insertion and^ ejdrajirtion, ; 
s^g^. respectively, thereby allowing the embedded 
vagrtai to be extracted writhout access to the unwater- 
marked original data. 

^ In EP-patent application No 97 11 53 53.1 conre- 
spprxJing to U.S. Patem Application Serial No. 
08/708.331 . filed September 4. 1 996. entitled "A Spread 
SpiKntrum Watermark for Embedded Signaling" by Ck)x, 
and incorporated herein by reference, there fe 
described a method for extracting a watermark of 
embedded data from watermarked images or video 
without using an original or unwatermarked version of 
the data. This work can be viewed as an extension of 
tiie original work of Preuss et al from tiie audio domain 
to images and video. 

This method of watermarking an image or image 
data for embedding signaling requires that tine DCT 
(discrete cosine transform) and its inverse of the entire 
image be computed. There are fast algorithms for com- 
puting the DCT in A/ log A/ time, where N is the number 
of pixels in ttie image. However, for A/=512x512. tiie 
computational requirement is still high, particularly if tiie 
encoding and extracting processes must occur at video 
rates, i.e. 30 frames per second. This method requires 
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approximately 30 times the computation needed for 
MPEG-II decompression. 

One possible way to achieve real-time video water- 
marking is to only watermark every frame. However, 
content owners wish to protect each and every video 
frame. Moreover, if it is known which frames contain 
embedded signals, it is simple to remove those frames 
with no noticeable degradation in the vkJeo signal. 

In U.S. Patent Application Serial No. 08/715.953. 
filed Septemt>er 19, .1996. entitled "Watermarking of 
Image Data Using MPEG/SPEG Coefficients" by Cox, 
and incorporated herein by reference, there is 
desaibed an alternative method, which is to insert the 
watermark into nxn blocks of the image (subimages) 
where n«N Then the computation cost is 

N 

- n log n = A/ log /? . 



For N^512x512^2^^ and n^8x8=2^. the asymp- 
totic saving is only a factor of 3. However, empirically the 
cost of computing the DCT over the entire image may 
be significantly higher when cache, loop unfolding and 
other efficiency issues are considered. Thus, the practi- 
cal difference may approach a 30 fold savings. More 
importantly, if the block size is chosen to be 8x8. i.e. the 
same size as that used for MPEG image compression, 
then it is possible to tightly couple the watermark inser- 
tion and extraction procedures to those of the MPEG 
compression and deconpression algorithms. Consider- 
able computatipnal saving can then be achieved since 
the most expenses computations relate to the calcula- 
tion of the DCT and its inverse and these steps are 
already computed as part of the compression and 
decompression algorithm. The incremental cost of 
watermarking is then very small, typically less than 5% 
of the conputational requirements associated with 
MPEG. 

The present invention improves the reliability of the 
invention described in the 08/715,953 application by 
storing watermark information into subimages. and 
extracting watermark information from subimages, in a 
manner different from that described earlier. 

The present invention improves the reliability of the 
prior systems by systematically varying the order in 
which watermark signal components are inserted into 
each subimage, by inserting only part of the watermark 
signal into each subimage. and. during watermark 
detection, by combining the watermark signals found in 
groups of subimages to reconstruct the original water- 
mark signal before testing for correlation with any pre- 
defined watermarks 

For detection, a reverse transformation is applied to 
each subimiage to reconstruct the watermark informa- 
tion that was stored in that subimage. The resulting sig- 
nals are then averaged together to reconstruct the 
whole watermark, and to reduce noise. Finally, this 



reconstructed watermark is connpared against a prede- 
fined set of watermark signals to determine which one 
was inserted into the image. 

A principal object of the present invention is there- 
5 fore, the provision of inserting a subset of a watermark 
into a subset of subregions of data to be watermarked. 

Another object of the invention is the provision of a 
digital watermarking system in which a watermark is 
eictracted by averaging the watermarked signal from 
10 subregions of watermarked data, and then correlating 
the resulting signal to determine the watermark 

A further object of the invention is the provision of a 
digital watermarking system in which the watermark Is 
composed of two portions, a verification portion and a 
15 synchronization portion, in order to improve watermark 
extraction reliability 

Further and still other objects of the invention will 
become more clearly apparent when the following 
description is read in conjunction with the acconpany- 
20 ing drawing. 

Brief Description of the Drawings 

Rgure 1 is a schematic block diagram of watermark 
25 insertion procedure; 

Figure 2 is a schematic block diagram of a water- 
mark insertion procedure in accordance with the 
teachings of the present invention; 
Rgure 3 is a schematic block diagram of a water- 
so mark extraction procedure; 

Figure 4 is a schematic block diagram of a water- 
mark extraction procedure in accordance with the 
teachings of the present invention; 
Rgure 5 is a graphic representation of a zigzag pat- 
35 tern useful for vectorizing subimages; 

Rgure 6 is a graphic representation of rotation of 
PN sequences; 

Rgure 7 is a graphical representation of an 8x8 
block shown the spatial relation of averaged terms; 
40 Rgure 8 is a schematic block diagram of a method 
for Inserting watermarks in accordance with tiie 
present Invention; and 

Rgure 9 is a schematic block diagram of a method 
for extracting watermarks in accordance with tiie 
45 present invention. 

Detailed Description 

Referring now to the figures, and Figures 1 through 
so 4 in particular, there is shown schematic block diagrams 
of a general metiiod for inserting and detecting water- 
marks in digital data, for instance images. 

In tiie following description, reference may be made 
to image data or images. While tiie invention has appli- 
55 cability to image data and images, it will be understood 
ttiat the teachings herein and the invention itself are 
equally applicable to video, image and multimedia data 
and the term "image" and "image data" will be under- 
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stood to include these terms where applicable. As used 
herein, "watermark" will be understood to include 
en^edded data, symbols, images, instructions or any 
other identifying Infomnation. 

In the following description, reference is made to 
procedures described in U.S. Patent Application Serial 
No. 08/534.894 for inserting and extracting or detecting 
a watermark in images as INSERT-ORIGINAL and 
EXTRACT-ORIGINAL, respectively Reference is made 
to procedures described in U.S. Patent Application 
Serial No. 08/708.331 filed September 4, 1996 for 
inserting and extracting or detecting watermarks in 
images as INSERT-WHOLE and EXTRACT-WHOLE, 
respectively AtkI reference is made to procedures 
described in U.S. Patent Application Serial No. 
08/715,953 for inserting and extracting or detecting 
watermarks in Images as INSERT-MPEG-A and 
EXTRACT-MPEG-A, respectively 

Rgure 1 shows a schematic block diagram of 
INSERT-WHOLE procedure for inserting watermarks 
into images. The watermark signal, in the form of a finite 
sequence of symbols chosen from an alphabet, is pro- 
vided as an input to an error correction encoder 10 
which transforms this sequence into another sequence 
that contains redundant information. The output of 
encoder 10 is provided to a PN-mapper 1 1 , which maps 
each symbol of the encoded watermark into a pre-spec- 
if ied pseudo-random noise (PN) code. The output of the 
PN-mapper 11 is provided to a spectral transformer 12, 
which converts the pseudo-random noise sequence into 
the frequency domain. The conversion preferably is by 
discrete cosine transform (DCT), however, fast fourier 
transform, wavelet type decomposition and the like may 
also be used for frequency conversion. Concurrently, 
the data to be watermarked is provided to another spec- 
tral transformer 13. The outputs of the two spectral 
transformers 1 2 and 13 are then provided as Inputs to a 
spectral shaper 14, which modifies the spectral proper- 
ties of the F)seudo-random noise codes from spectral 
transformer 12 to mask the watermark when acfcied to 
the image data The spectrally transformed data to be 
watermarked, from spectral transformer 13. is also pro- 
vided as an input to a delay 1 5. The output of the spec- 
tral shaper 1 4 is then added to the output of delay 1 5 at 
a summer 16. The summer output is subject to an 
inverse transform 1 7. The result of the inverse transform 
is watermarked data. 

INSERT-MPEG-A differs from INSERT-WHOLE by 
segmenting the data to be watermarked irrto multiple 
blocks, such as 8x8 pixel subimages or subregions. 
Each block of data then has the watermark inserted 
according to the above described method. That is. for 
each 8x8 subimage or subregion. a pseudo-random 
number (PN) sequence is inserted into the DCT coeffi- 
cients after suitable spectral shaping. The procedure is 
repeated for all such subimages or subregions. The size 
of the subimage or subregion is preferably 8x8. but it 
can be of other sizes, such as 2x2, 3x3, 4x4 or 16x16. 



Figure 2 shows a schematic block diagram of a 
watermark insertion procedure in accordance with 
teachings of the present invention. The watermark sig- 
nal is processed into a noise spectrum signal by the 
5 error connection encoder 20. the PN mapper 21 . and the 
spectral transformer 22, in the same manner as 
described In conjunction with Figure 1 . However, unlike 
INSERT-WHOLE or INSERT-MPEG-A. the watermark is 
then used as an input to a watermark segmenter 23. 

10 which systematically separates the waternnark into sev- 
eral subwatermarks. Any portion of the original water- 
mark might appear redundantly in several of the 
resulting subwatermarks. Concurrently, the data to be 
watermarked is used as an input to data segmenter 24. 

IS which segments the data into blocks or subregions. 
such as 8x8 subimages. as in INSERT-MPEG-A. Each 
of the subwatermarks output by the watermark seg- 
menter 23 is then inserted into a data block by one of 
the watermark inserters 25a. 25b. etc. The procedure 

20 used by the watermark inserters 25a. 25b. etc.. is the 
same procedure desalbed connection with watermark 
inserter 18 in Figure 1. That is. each subwatermark is 
added into a spectrally trarsformed data block after 
spectral shaping, and the resulting data is then trans- 

25 formed back into the spatial domain. Rnally, the water- 
marked data blocks from the watermark inserters 25a, 
25b, etc.. are assembled by data combiner 26 to pro- 
duce watermarked data 

Figure 3 shows a schematic block diagram of the 

30 EXTRACT-WHOLE procedure. The watermarked 
image, video or multimedia data is first used as input 
into a spectral normalizer 30 to undo any previotely per- 
formed spectral shaping. If the data contair^ a water- 
mark, then the output of the spectral normalizer 30 will 

35 resenr^e the spectral transformation of the PN coding 
of that watermark (the signal that was input to the spec- 
tral shaper 14 in Figure 1). The output of the spectral 
normalizer 30 is then used as an input to several conre- 
lators 31a. 31b, etc.. which test the watermark with the 

40 PN codes used to represent the various symbols that 
the encoded watermark might contain (i.e. each correla- 
tor tests for one PN code that is used to encode a sym- 
bol by the PN mapper 1 1 of Figure 1). The outputs of the 
correlators 31a. 31b, etc.. are used as inputs to a deci- 

45 sion circuit 32. which determines the most likely 
sequence of symbols. Finally, this sequence is cor- 
rected by an, error corrector 33. which performs the 
inverse coding that was performed by the error con-ec- 
tion encoder 10 in Rgure 1. The result is the extracted 

so watermark. 

In EXTRACT-MPEG-A. the data from which a 
watermark is to be extracted is first segmented into sev- 
eral blocks, such as 8x8 subimages. exactly as in 
INSERT-MPEG-A. The signal from each subimage is 

55 then normalized and used as input into a bank of conre- 
lators similar to the correlators 31a, 31b. etc. in Figure 
3. The output from the correlators is then averaged with 
the outputs of corresponding correlators from other 
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subimages, ,and :the resulting average, coiTelatipns are:,d 
used as inputs £ into the: decision circuit 32 for subser , 
quent processing as described above.3:Ld :i t'udof jui 
Figure -4 shews a schematic block diagram , of a- ^ 
watermark extraction procedure in accordance with the ^ 5: - 
teachings of the} present iriventipa j^^ n r , 

data Is first segmented into jDlocte by data segmenter .r 
40. which corresponds tO:th% data segmem^^ ^ ; v; 

during the insertion prpcedurejn Figure 2. Eachioithe 
data blocksuSiprqytded Jo a r io. 
malizer 41 ar:4f1b,jetCutO: produce :a^^ 
the subwatermark that was inserted into thejespectiye r r 
data block.} Jhese^insertedcS^ . 
then used asjnputs lntp:a watermark combiner jj|2. In .t,; 
the cornblnerv42vrpartS(^of.the waterrra appear .v?5; 
redundantly.viiT,; severaL subwatern^ ^are averaged 
together toj-eduee noise;? Jlie output o^the watermark : 
combiner 42 is.pirgvidedia5,j^^ sepa^.^^ . 

rater 43 wWdiHGlivides the jwaternrmrk irtop of}j:^i?A 
which cprre§ppnd^ 

watermark signal (the ouftji^ pi-eiror c^^^ 4ncpderu:.; rr 
20 in Figure?),.^ s >m..?:^ -.;r^^H^.. I ; 

These synrtitiols^frpm separatpr:^43 are. provide^ , 5. 
inputs to respective watermark identrffiefs 44a, 44b etc. ; <, 
each of which.incjudes of a^bankiofcojrelators ar^^^ 2S 
decision circuit as shown in Figure 3;,.;ini.ejputputs ofthe.^ , ; 
watermark .identifler?^^ ^ ^ 

used in thef> original; encpd^ 

identified syrr^iotetare.reas^^^ , 
encoded watermark by , the sy^^ 45. Finally. - 3o 

the resulting,, encoded iV^^^^ decoded i^y the,^. : 

error corrector. 46. ■ ■ . -?^ir^;^i.k,."^t^r: -;t -^^th;;/^r-;>; ■* - 

The ihserlion aride^ 
described in^mpi^ -^^ 

EXTRACT-ORIGIt^J^d-. t^^ object is to embed a sjngje 3^ . 
PN (pseudo, random, nunil)er) sequence: into an irnage . 
when the original, image iSvayaila^ 
extraction. TTie irtformmipn^ass^ 
sequence is .assumcd^^ t^^^ ba, stored in a database s , 
togetiier with the, originaJ. irnage a spectral loca- 40 
tion of the en*edded waterm^ The locations pf^^t^^^ 
watermarked components has to bie recorded because 
the implementation approxinriated tfie N perceptually 
most significant regions of the yyaterrnark by the N larg- 
est coefficients. However, thjs ranking was riot invariant 45 
to the watermarking process.. The N largest coefficients 
may be different after inserting the waterrnark than 
before insertirig the watermark. 

In order to avoid this problem, the present invention 
places a watermark in predetermined locations of the so 
spectrum, typically the first N coefficients- However, any 
predetermined locations could be used, though such 
locations should belong to the perceptually significant 
regions of the spectrum if the watermark is to survive 
common signals transformations such as compression, ss 
scaling, etc. 

More generally, the information to be embedded is 
a sequence of m symbols drawn from an alphabet A 



(e.g. the binary digits or the ASCII syrribols). This data 
is then supplemented with additional :Symbols for en-or 
detection and correction. Each symbol is then spread 
spectrum modulated, a process that maps each symbol 
into a unique PN sequence known as a chip. The 
number of bits per chip is preset - ttie longer the chip 
lengtii, the higher the deterted signai-to-ripise ratio will 
be. but this is at the expense of signalirig bandwidth, 
-ri/ The power spectrum of the PN sequence Is white, 
i.e;jflat, and is- thei;efore shaped; to match thm of the 
Tnojse", i.e. tiie image/video/audio/or multimedia data 
into which the watermark is to be embedded. It is this 
spectra! shaping that must be modified from the prior 
methods so that the extraction -process no longer 
requires the original image. To do^this. each coefficient 
of the watermarked spectrum is scaled by the local 
average of tiie power in the image spectral coefficient 
rather tiian the coefficlerTt itself, i,e.-;-:T v - 



ir ; cv^ The averaging is the ayeraging^pf the absolute; coef- 
ficient values and not the:coefficient values^thentselyes.v 
This is effectiyely.^stimaljng the average power; present., 
at each frequericy. Other averaging procedures are pos-* 

t Sible, for exaniple; averaging^ ovM:seyeraLf^^ 
average of local neighbprhoodsjpf $x8 bl ofisj -^^^ ^5^^ 

c >::This average may^De. obtained Jn several ways, ft 
maybe a Ipcal average oyer a two ^limensional r^egion. . 

:Afternatively.,the^two dimerisional spectrum may be : 
sarnpled to -form a pnet,djmensional,yectpr-arKl, a one 
dimensional riocalv average^ :r^ perfbrmeda ,One ? 
dmein^ional^ )^ of ; tbf. |yo:^d 

OCT coeffidents is alneady/pe 

Jl.The average TOy, be a anple to^ weighted aver-, 
age over the neighborhood. ^1^^^^ \ v : t =n= . : 

For wdeo data. teiinF^^ 
coefficients oyer several frarnes can also be applied.. 
However, sirice several frarnes are needed, for ayerag-. : 
ing at the spectral nprrnalization stage of the extractor, 
the protection of iridiyidual video frarnes taken in isola- 
tion may not be possible. For this reason, tfie present 
invention treats video as a very large collection of still 
images. In this way, even individual video frames are 
copyprotected. . 

In order to extract the watermark, it is necessary to 
perform the spectral normalization, in which the previ- 
ously performed spectral shaping procedure is inverted. 
In the present invention, the original unwatermarked 
signal is not available. Thus, the average power of the 
frequency coefficients. avg{\ffj[),\s approximated by the 
average of the watermarked signal, i.e. avg(\ff\) 



avg(\ff\)^ avg(\fi\) 



(2) 



This is approximately true since aavg{\fi\)Wi«fi, 
where is the watermark conponent. and a is a con- 
stant typically in the range between 0.1 and 0.01 . 
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The normalization stage then divides each coeffi- 
cient [f] ) in the received signal by the local average avg 
(\fi\) in the neighborhood. 

That is. 

fj VctavgdM)^/ .. _A_^^M/ (3) 

avg(\fi\) ■ av5(IM) " avgilffQ 

The first term, on the right hand side (RHS) of 
Equation (3) . 

L 



is considered a noise term. This term was not present in 
the system described U.S. Patent Application Serial No 
08/534,894, because access to the unwatermarked 
coefficients allowed this term to be removed. The sec- 
ond term a Wj is the original watermark signal which can 
now be detected usirig conventional correlation. 

If the watermark is extracted from any single 8x8 
block, the detector reliability is very low. If. however, the 
watermarks extracts from each 8x8 block are first 
added together and the averaged watermark Is then 
applied to the correlator, then a very strong and unam- 
biguous response is obtained. This differs from the 
method described in U.S. Patent Application Serial No 
08/715,953 in which correlation occurred within each 
block and the output from each con-^ator was averaged 
together. The present invention was found to improve 
the detection response and significantly reduced the 
computation requirement associated wrth each block. 

In practicing the present invention preferably there 
is a unique FN sequence for each symbol in the alpha- 
bet. The method is relatively robust to clipping since the 
detector output reduces linearly with the quantity of 8x8 
subimage blocks in the image. For DVD (digital video 
disk) embedded signaling for APS (analog protection 
system) and CGMS (copy generation management sys- 
tem), there would be a total of 8 or 16 PN sequences. 

The nurrtoer of 8x8 tilocks in a 512x512 image is 
4096. suggesting that signiftoantiy more than one of 16 
symbols can be embedded in an image or video frame. 
Assume, for example, that it is desired to embed 1 out of 
1 28 symbols in an image. It is necessary to perform 1 28 
parallel correlations. This is computationally tractable 
but hardware implementations of each correlation 
become more complex. An alternative method is to only 
use two binary synrdx>ls. It may be preferable to associ- 
ate more than one PN sequence with each of the two 
binary synr^ols or bits in order to increase the difficulty 
of intentionally removing the waternnark. In this case, 
there are only two con-elators and a binary string may 
be embedded into the image. The raw bit error rate will 
be very high due by the low detector output. However, 



this can be reduced to acceptatrfe levels by using enror 
correcting codes, such as Reed-Solomon (RS). RS 
codes are robust to burst en-or which may occur 
because of clippng of the image. Other enror correcting 
codes may also be used. 

When using thfe method, it is necessary for the 
receiver to know the start location of the encoded block. 
The start location may not be obvious, particularly when 
the image has been subjected to clipping. However. 
0 convention synchronizing methods can be used; such 
as preceding each blod^ with a special or unique sym- 
bcH or string of synrdDols. 

To insert a watermark, each 8x8 block is treated as 
an individual subimage or subregion. Tile DCT of the 
15 subimage is then computed and the two dimensional 
DCT is vectorized in the zigzag pattern shown in Figure 
5. although other patterns are also possible. These two 
stages constitute most of the calculations but are part of 
the MPEG encoding process. Next, a PfM noise 
20 sequence {w, ...Wnj is inserted into the DCT coefficients 
using Equation 1 as before. The length of the PN 
sequence cannot exceed 64 (in an 8 x 8 block) and is 
typically much shorter, in the range of 1 1 to 25. If only a 
single code is to be inserted into the image, then the 
25 same PN sequence is inserted into each of the 720 x 
480/64 - 5400 blocks. However, a variation may be per- 
formed at this point in tiie procedure. Within each row of 
blod<s. the PN sequence is cyclically rotated by one fre- 
quency coefficient prior to insertion in the subsequent 
30 block. Similarly, the PN sequence is cyclically rotated by 
one frequency coeffident at the start of each new row. 
Figure 6 illustrates an order of rotations. 

The purpose of these rotations or shifts is to 
improve the response of the watermark extraction 
35 stage. Earlier experiments revealed that certain DCT 
coefficients were more difficult to estimate than others. 
The location at these coefficients varied from image to 
image. However, within an image, the coefficient could 
be consistently poor. Consequently, without shifting, 
40 one or more of the estimated watermark coefficients 
could be significantly degraded relative to the other 
watermark coefficients, thereby reducing the detector 
performance. Conversely, shifting significantly reduces 
the effect a poor DCT coefficients has on a single water- 
45 mark coefficient and the detector performance is mark- 
edly improved. Note that any cyclic pattern can be used. 

Further modif icatiore are useful once rotation of the 
watermark has been introduced. First, the length of the 
watermark may now be significantly greater than 64. 
50 Then, for each block only a small subset of the water- 
mark (say five) coefficients is inserted into the first five 
DCT coefficients (excluding the d.c. term). Because of 
the rotation, a different subset of the watermark 
insert^j into neighboring 8x8 blocks. Finally, having 
55 completed the watermark insertion, the MPEG ^coder 
is able to proceed with the subsequent stages of com- 
pression. 

Note that the watermark may also be inserted after 
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the MPEG quantization stage to reduce distortion of the 
watermark. MPEG-2 performs a convenient one dimen- 
sion vectorization called "zigzagging", which allows a 
simple 3x1 box average to be performed on the coeffi- 
cients (excluding thed.c. term). 

In practice, performance was improved if the aver- 
aging is performed using the 2 four-connected coeffi- 
cients closest to the d.c. term, as illustrated in Figure 7, 
i.e. the two coefficients above and to the left. 

Watermark detection begins by first extracting the 
PN noise sequence from each 8x8 block using Equation 
1. For each block, the PN sequence is then cyclically 
shifted in the opposite direction by one frequency coef- 
ficients, and the average over all the blocks is then com- 
puted. In practice, this process can be computed 
incrementally and does not require temporary storage 
of all the extracted watermarks. A weighted averaging 
can also be applied, where the weights are determined 
based on their susceptibility to common signal transfor- 
mations such as low pass filtering. Rnally. the average 
watermark is compared with the original PN sequence 
via correlation. The reason for shifting the watermark in 
the column direction may now be apparent. If the image 
is clipped on an arbitrary block boundary, then the com- 
puted average watermark will simply be rotated by an 
amount that is a function of the relative location of the 
clipped portion of the image. Correlation can then be 
performed on all permutations (typically 11 to 25) of the 
watermark. The output from the correlator with tiie max- 
imum value is then used for decision purposes. The 
extraction stage is depicted in Figure 4. Taking the max- 
imum correlator output over all rotations of the water- 
mark can cause the decision circuitry to be noisy. To 
improve this, tiie watermark is broken into two pieces; a 
synchronisation portion is of lengtii K and a verification 
portion is N-K Then, when tiie watermark is extracted 
as before, correlation is first performed only on all rota- 
tions of the synchronization portion of tills watermark. 
The maximum congelation output is noted, then tile veri- 
fication portion of the watermark is rotated by the corre- 
sponding amount and a second correlation is performed 
on the verification portions of tiie watermarks. This 
process significantiy improves the overall reliability of 
the system. In the course of experimentation, it was 
noticed that some watermarks performed better tiian 
others on the same imagery. This was caused by varia- 
tion in the correlation statistics between the synchroni- 
zation and verification portions of the watermark. 
Ideally, the two portions should have very low correla- 
tions. However, in several cases where watermarks per- 
formed poorly, it was traced to unexpected correlations 
between the two portions. 

The present invention provides a modification to 
digital watermarking methods in which the original data 
is required for watermark extraction thereby enabling 
watermarking exti-action in the absence of an unwater- 
marked or original data. The present invention prefera- 
bly uses MPEG/JPEG coefficients. An image is divided 



into typically 8x8 block subimages or subregions and 
each subimage is processed and the results are com- 
bined to derive the extracted watermark. The result is 
extraction of tiie watermark with very high confidence. 
5 While the above invention describes improvements 
to the prior-art INSERT-WHOLE, INSERT-MPEG- A, 
EXTRACT WHOLE, and EXTRACT-MPEG-A algo- 
rithms, it should be apparent to anyone skilled in tiie art 
that the same improvements may be applied to any 
10 algorithm for inserting and extracting watermarks in 
image data. This more general view of the present 
invention is shown in Rgures 8 and 9. 

Rgure 8 shows a schematic block diagram of the 
general method for inserting watermarks. This general 
IS method makes use of a non-block-based watermark 
insertion algorithm, which shall be referred to hereafter 
as the "base insertion algoritiim". The watermark 
encoder 80 converts the watermark into a form appro- 
priate for the base insertion algorithm. If the base inser- 
20 tion algorithm is that shown in Figure 1, for exarrple, 
then the watermark encoder 80 corresponds to the 
watermark encoder 19. which comprises tiie en-or cor- 
rection encoder 10. the PN mapper 1 1, and tiie spectral 
transformer 12. However, if a different base insertion 
25 algorithm is to be used, then tiie watermark encoder 80 
may perform a different transformation of tiie water- 
mark. The encoded watermark signal from watermark 
encoder 80 is provided as an input to watermark seg- 
menter 81. which divides tiie watermark into a set of 
30 subwatermarks. Any portion of the original watermark 
might appear redundantly in several of the resulting 
subwatermarks. The data to be watermarked is pro- 
vided as an input to data segmenter 82, which divides 
ttie data into subregions. Each subwatermark is 
35 inserted into a respective data subregion by a water- 
mark inserter 83a, 83b. etc. The watermark inserters 
implement the base insertion algorithm, so, if the base 
insertion algorithm is that shown in Figure 1. then each 
watermark inserter 83a, 83b. etc.. corresponds to the 
40 watermark inserter 18, whrch comprises a spectral 
transformer 13, a spectral shaper 14, a delay 15. a sum- 
mer 16, and an inverse ti-anstorm 17. However, if a dif- 
ferent base insertion algorithm is to be used, then tiie 
watermark inserters 83a. 83b. etc.. may employ a differ- 
45 ent metiiod of inserting subwatermarks into tiie subre- 
gions of the data to be watermarked. The outputs from 
tiie watermark inserters are assembled in data com- 
biner 84 to provide watermarked data. 

Figure 9 shows a schematic fcHock diagram of tiie 
50 corresponding general extraction algoritiim. The algo- 
rithm makes use of a "base extraction" algoritiim ttiat 
corresponds to the base insertion algorithm used in 
inserting the watermark into tiie data to be watermarked 
(Figure 8). The algorithm in Figure 9 is substantially tiie 
55 same as the aJgoritiim shown in Figure 4. except tiiat, in 
the general case, the spectrum normalizers 41 a, etc. 
are replaced by watermark exti-actors 91a. etc., which 
implement the base extraction algorithm. That is, if tiie 
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base insertion algorithm used was the algorithm shown 
in Figure 1. then the watermark extractors 91a. etc.. in 
Figure 9 will be the spectmm normalizers 41a. etc. in 
Figure 4. 

While there has been described and Illustrated a s 
system for inserting a watermark into and extracting a 
watermark from watermarked data without using an 
unwatermarked version of the data, it will be apparent to 
those skilled in the art that variations and modifications 
are possible without deviating from the broad principles i 
and teachings of the present invention which shall be 
limited solely by the scope of the claims a^Dended 
hereto. 

Claims ^ 

1 , A method for inserting a watermark signal into data 
to be watermarked comprising the steps of : 

dividing data to be watermarked into a plurality 20 
of subregions; 

computing frequency coefficients of the data to 
be watermarked in each subregion; 
spread spectrum modulating a watermark sig- 
nal to be inserted by mapping the waternnark 25 
signal into a PN (pseudo-random noise) 
sequence; 

spectral shaping the PN sequence as a func- 
tion of the average power in each frequency 
coefficient of the data; and 30 
inserting each spectral shaped PN sequence 
into predetermined coefficients in the data in 
each subregion. 

2. A method for inserting a watermark signal into data 3s 
to be watermarked as set forth in claim 1 . where 
said frequency coefficients are DOT (discrete 
cosine transform) coefficients. 

3. A method for inserting a watermark signal into data 40 
to be watermarked as set forth in daim 1 or 2, 
where each subregion is a 8 x 8 block of pixels. 

4. A method for inserting a watermark signal into data 
to be watermarked as set forth in claim S.where the 45 
frequency coefficients of the watermark signal are 
rotated prior to inserting of each spectral shaped 
PN sequence into the subregion. 

5. A method for inserting a watermark signal into data so 
to be watermarked as set forth in daim 4, where 
only a subset of the watermark signal frequency 
coefficients is inserted into any one subregion. 

6. A method for inserting a watermark signal into data ss 
to be watermarked as set forth in claim 5 . where 
the watermark signal comprises a synchronization 
portion and a verification portion. 



7. A mettiod for inserting a watermark signal into data 
to be watermarked as set forth in any of claims 1 to 
6, where said inserting is performed after the data 
undergoes MPEG quantization processing. 

8. A method for inserting a watermark signal into data 
to be watermarked as set forth in dain^ 6 or 7. 
where the synchronisation portion and tiie verifica- 
tion portion have very little congelation between 
each other. 

. A method for inserting a watermark signal into data 
to be watermarked as set forth in any of claims 1 to 
8, 

where the spectral shaping as a function of the 
average power is typically 3x1 window of the 
coefficient obtained from the one-dimensional 
vectortzation by zigzagging of two-dimension 
frequency coefficients. 

1 0. A method for inserting a watermark signal into data 
to be watermarked as set forth in any of claims 1 to 
8, where the specti^al shaping is a function of the 
average power based on the two four-connected 
frequency coefficients closest to the DC term. 

11. A method of extracting a watermark from water- 
marked data comprising the steps of: 

receiving subregions of watermarked data; 
spectrum normalizing tiie watermarked data 
from each subregion to generate respective 
normalized signals; 

combining the respective normalized signals 
from each subregion to generate a single 
watermark; 

correlating the single watermark with predeter- 
mined PN (pseudo-random noise) sequences 
corresponding to predetermined symbols to 
provide conrelated signals for each predeter- 
mined PN sequence in each subregion; 
deciding which correlated signal is most likely a 
current symtx>l; and extracting a sequence of 
most likely current symbols corresponding to 
the watermark. 

12. A metiiod of extracting a watermark from water- 
marked data as set forth in claim 1 1 . where tiie sub- 
regions are 8 X 8 blocks used for MPEG encoding 
and decoding. 

13. A metiiod of extracting a watermark from water- 
marked data as set forth in claim 12. where said 
confining the normalized signals from each subre- 
gion to generate a single watermark, including 
removing the relative rotation of tiie watermark 
between blocks. 
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14. A methcxj of extracting a watermark from water- 
marked data as set forth in claim 13. further com- 
prising subsequently reconstructing the watermark 
from partial watermarks inserted into each block. 

5 

15. A method of extracting a watermark from water- 
marked data as set forth in claim 14, further com- 
prising weighting the watermark coefficients based 
on their location within the frequency spectrum, 
where the weighting is a function of the susceptibil- io 
hy of each frequency coeff ident to common signal 
transformations. 

16. A method of extracting a watermark from water- 
marked data as set forth in claim 11, further com- is 
prising correlating with all rotational shifts of the 
extracted watermark and selecting the maximum 
value. 

17. A method of extracting a watermark from water- 20 
marked data as set forth in claim 1 1 , further com- 
prising correlating with all rotational shifts of a 
synchronization portion of a watermark to deter- 
mine a maximum value and subsequently rotating a 
verification portion of the watermark by the same 2S 
amount as the synchronization portion is rotated to 
obtain the maximum value prior to correlating 
between the verification portion and predetermined 

PN sequences. 

30 

18. A method of extracting a watermark from water- 
marked data comprising the steps of: 

receiving subregions of watermarked data; 
spectrum normalizing the watermarked data 3S 
from each subregion to generate respective 
normalized signals; 

con-elating the respective normalized signals 
with predetermined PN sequences corre- 
sponding to predetermined symbols to provide 40 
con-elated signals for each predetermined PN 
sequence in each subregion; 
deciding which con-elated signal Is most likely a 
cun-ent symbol In each subregion for providing 
an extracted symbol stream; 45 
error correcting the extracted symbol stream; 
and 

extracting a sequence of most likely current 
symbols corresponding to the watermark. 

50 

19. A method of extracting a watermark from water- 
marked data as set forth in claim 18, where said 
error correction is Reed Solomon error connection. 

20. A method for Inserting a watermark signal into data ss 
to be watermarked comprising the steps of: 

dividing data to be watermarked into a plurality 



of subregions; 

dividing a watermark signal into a plurality of 
subwatermarks where portions of the water- 
mark are contained In more than one subwater- 
mark; and 

inserting said plurality of subwatermarks into 
said plurality of subregions. 

21. A method for inserting a watermark signal into data 
to be watermarked as set forth in claim 20. where 
each subwatermark is inserted into a respective 
subregion, so that each subregion contains at least 
one subwatermark. 

22. A method for extracting a watermark signal from 
watermarked data comprising the steps of: 

receiving a plurality of subregions of watermark 
data; 

extracting a subwatermark from each subre- 
gion of said plurality of subregions; and 
combining and averaging the subwatermarks 
extracted from all the subregions to obtain a 
signal commensurate with the watermark sig- 
nal 

23. A method for extracting a watermark signal from 
watermarked data as set forth in claim 22. further 
comprising the steps of: 

dividing the signal commensurate with the 
watermark signal into a plurality of symbol sig- 
nals; 

correlating each symbol signal with a set of 
predefined signals; 

determining which predefined signal best cor- 
responds to each symbol signal; and 
combining the best corresponding predeter- 
mined signals to generate the watermark sig- 
nal. 



9 



0B40513A2 I > 



EP 0 840 513 A2 



WATERMARK 
SIGNAL 



WATERMARK 
ENCODER 



1 9 



1 0 



ERROR 
CORRE 
ENCOD 


CTION 
ER 




. 5' 


PN MAPPER 




. }' 


SPECTRAL 
TRANSFORMER 



1 1 



1 2 



FIG 1 



DATA TO BE 
WATERMARKED 



WATERMARK 
INSERTER 



1 8 



SPECTf 
TRANSf 


' , ,., 
tAL 

"ORMER 







1 4 



1 3 



SPECTRAL 
SHAPER 



1 5 



DELAY 



^1 6 



INVERSE 
TRANSFORM 



^1 T 



WATERMARKED 
DATA 



10 



EP 0 840 513 A2 



WATERMARK 
SIGNAL 



2 0 



ERROR 

CORRECTION 
ENCODER 



2 1 



PN MAPPER 



2 2 



SPECTRAL 
TRANSFORMER 



2 3 



WATERMARK 
SEGMENTER 



FIG 2 



DATA TO BE 
WATERMARKED 



1 



DATA 

SEGMENTER 



J 



2 4 



WATERMARK 
INSERTER 



^2 5 a 



TTT 



2 5b 



WATERMARK 
INSERTER 



2 5 



WATERMARK 
INSERTER 



2 f X X X > f_ 



DATA 

COMBINER 



T 



2 6 



WATERMARKED 
DATA 



11 



EP 0 840 513 A2 



WATERMARKED 
DATA 



1 



SPECTRUM 
NORMAL I ZER 



3 0 



i 



3 1 a 



CORRELATOR 



i 



3 1 b 



CORRELATOR 



DECISION 
CIRCUIT 



WATERMARK 
IDENTIFIER 



3 1 j 



CORRELATOR 



3 2 



ERROR 
CORRECTOR 



3 3 



FIG 3 



EXTRACTED 
WATERMARK 
SIGNAL 



12 



EP 0 840 513 A2 ? ' 



WATERMARKED 
DATA 



1 



£ 



DATA>. 
SE GMENTER 



SPECTRUM 
NORMAL IZER 



4 1 a 



A/. 4 0 



SPECTRUM 
NORMAL! ZER 



4 1b 



SPECTRUM 
NORMAL I ZER 



Ir y X XX J" 



J 



WATERMARK 
COMBINER 



SYMBOL 
SE PARATOR 

rrr 



WATERMARK 
IDENTIFIER 



-^4 4 a 



I 



^-4 2 
4 3 



WATERMARK 
IDENTIFIER 



4 4b 



WATERMARK 
IDENTIFIER 



4 I i 



4 i 



If Jf 1 i J> J" 



Fia 4 



SYMBOL 
COMBINER 

X 



^4 5 



ERROR 
CORRECTOR 



✓\^4 6 



13 

3D0CID: <EP OaMJSi.-^A? I ^ 



EP 0 840 513 A2 



FIG 5 




FIG 6 



FIG 7 



dc 












• 






• 


X 













14 



EP 0 840 513 A2« 



WATERMARK 
SIGNAL 



8 0 



WATERMARK 
ENCODER 



8 1 



WATERMARK 
SEGMENTER 



£ 



WATERMARK 
INSERTER 



DATA TO BE 
WATERMARKED 



i 



DATA 

SEGMENTER 



8 3a 



TTT 



i 



8 3 b 



watermark 

inserter; 



8 2 



8 3 j 



WATERMARK 
INSERTER 



FIQ 8 




WATERMARKED 
DATA 



3DOClD:<EP 0840S13A2 I 



15 



EP 0 840 51 3 A2 



WATERMARKED 
DATA 



1 



DATA 

SEGMENTER 

rrr 



WATERMARK 
EXTRACTOR 



^9 1 a 



j: 



WATERMARK 
IDENTIFIER 



FIG 9 



^4 0 



WATERMARK 
EXTRACTOR 



^9 1 b 



l1 



1 1 i i i r 



WATERMARK 
EXTRACTOR 



WATERMARK 
COMBINER 



SYMBOL 
SE PARATOR 

rrr 



4 4 a 



4 2 



4 3 



WATERMARK 
IDENTIFIER 



4 4b 



WATERMARK 
IDENTIFIER 



9 1 i 



1 X i i i r 



4 4 I 



SYMBOL 
COMBINER 



ERROR 
CORRECTOR 



4 5 



4 6 



16 



(19) 



J 



EuropSisches Patenlamt 
European Patent Office 
Office europ^en des brevets 



(12) 



(11) EP 0 840 513 A3 

EUROPEAN PATENT APPLICAfidN - 



(88) Dateof publication A3: 

24.05.2000 Bulletin 2000/21 

(43) Date of puk>!ication A2:v ^ 

06.05.1998 Bulletin 199^/19 : 

(21) Application number: 97119231.5 

(22) Date of filing: 04-11.1997 



(51) !nt.Cl7: H 04 N 7/24, H04N 1/32, 



H04N 7/30 



(84) Designated Contracting States: 


• Miller, Matthew L. 


AT BE CH DE DK ES R FR GB GR IE IT LI LU MC 


'^f; .-, yiijijui:(uif;^ ^ ..r. -.^Z 


NL FT SE 


Tanaka, Kazuypshi, . 


Designated Extension States: 


\: c/o NEC Corporal 


AL LT LV lUlK RO SI 


Minato-ku, Tokyo (JP) 


(30) Priority: 05.11.1996 US 746022 


• AMakasu, Y^aka; i 


c/o NEC Corporation 


(71) Applicant: NEC CORPORATION 


Minato-ku, Tokyo (JP) 


Tokyo (JP) 


(74) Representative:' 


(72) Inventors: 


VC^IUS'&JVVRTNER 

Sieb^i1strau&ie»4^ ' 


• Cox, Ingemar J. 


81675 MOnbh^nXPE); 


Lawrenceviile, NJ 08648 (US) 



CO 

< 

CO 

2r> 
o 

CD 



(54) Digital data watermarking 

(57) Digital watermarking of data, including image, 
video and audio data, is performed by repeatedly insert- 
ing the watermark into subregions or subimages of ttie 
data. Similarly, the watermark is repeatedly extracted 
from the subregions of the data. 



DATA TO BE 
tATERUAftKED 



ERROR 

CCRRECTIOR 
ENCODER 



DATA 

SEGIENTER 



SPECTRAL 
TRJINSFDRIER 



SEGUE ITTER - 



'^2 



-J I J I r 



WATERMARK 

INSERTER 



2 5 i 



lATERHARX. 
ItfSERTER 



5U? 



DATA 

COBBINER 



FIG 2 



lATERHARKEO 
DATA 



Q. 
LU 



Primed by Xerox (UK) Business Services 
2.167 (HRS)/3.6 



SDCXID: <EP 084051 ) > 



EP 0 840 513 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Numlser 

EP 97 11 9231 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



D,X 



A 
A 



Citation of document with indication, wrhere appropriate, 
of relevant passages 



COX I J. KILIAN J, LEIGHTON T. SHAMOON T: 
"Secure Spread Spectrum Watermarking for 
Multimedia" [Online] 

1995 . NEC RESEARCH INSTITUTE , TECHNICAL 
REPORT 95-10 XP002133927 
Retrieved from the Internet: <URL: 
ftp : //ftp . nj . nec. com/pub/ i ngemar/papers/wa 
termark.ps. Z> [retrieved on 2000-03-23] 
page 6, line 13 - page 6, line 22 * 
page 10, line 1 - page 15, line 14 * 

* page 9, line 4 - page 9. line 24, 
paragraph 4.3.1 * 

ZHAO J ET AL: "EMBEDDING ROBUST LABELS 
INTO IMAGES FOR COPYRIGHT PROTECTION" 
PROCEEDINGS OF THE KNOWRIGHT. CONFERENCE. 
PROCEEDINGS OF THE INTERNATIONAL CONGRESS 
ON INTELECTUAL PROPERTY RIGHTS FOR 
SPECIALIZED INFORMATION, KNOWLEGDE AND NEW 
TECHNOLOGY, 21 August 1995 (1995-08-21), 
XPOO0603945 

* page 244. line 1 - page 248, line 21 * 

HARTUNG AND GIROD: "DIGITAL WATERMARKING 
OF RAW AND COMPRESSED VIDEO- 
PROCEEDINGS OF THE SPIE.US,SPIE, 
BELLINGHAM, VA, 

vol. 2952, 7 October 1996 (1996-10-07), 
pages 205-213, XPO02085796 

* page 207. paragraph 3 - page 210, 
paragraph 5 * 

* figure 2 * 

-/" 



Relevant 
to daim 



CLASStnCATION OF THE 

appucahon (inLa.6) 



2G-22 



The present search report has been drawn up for all daims 



H04N7/24 
He4Nl/32 
H04N7/30 



1-3,11, 
12.18,19 
7.9.10. 
15.23 

1-3.11, 
12.18,19 



TECHNICAL FIELDS 
SEARCHED (lnt^.6) 



H04N 



1-23 



Place ct search 

THE HAGUE 



Date of comF^etion tit the search 

27 March 2000 



Fassnacht, C 



CATEGORY OF CiTED DOCUMENTS 

X : pvficutarty ralevant if takon olon* 

Y : partieulaiiy re)«vant if oombined with another 

d(»ument of ttie same category 
A : teehnologioaJ baokgrouftd 
O : non-wntten discJosure 
P : intermedtaie document 



T : theory or principle underlying the invention 
E : eartier patent document, but published on, or 

after the faing date 
D : document cited in the application 
L : document cfted for other reaaona 

& : member of the tame potent family, corresponding 
document 



2 



EP 0 840 513 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Appllcallon Number 

EP 97 11 9231 



DOCUMENTS CONSIDERED TO BE RELEVANT 




Category 


Citation of document with incfication, where appropriate, 
of relevant passages 


Relevant 
to claim 


CLASSinCATION OF THE 
APPLICATION (lntCI.6) 


A 


BORS AND PITAS: "IMAGE WATERMARKING USING 
DCT DOMAIN CONSTRAINTS" 
PROCEEDINGS OF THE INTERNATIONAL 
CONFERENCE ON IMAGE PROCESSING 
(ICIP),US,NEW YORK, IEEE, 1996. pages 
231-234, XP002095507 ISBN: 0-7803-3259-8 

* page 231, left-hand column, paragraph 1 

- page 231, right-hand column * 

* page 232, left-hand column, paragraph 3 

- page 232, right-hand coluirei * 


1-23 




A 


RUANAIDH J J K 0 ET AL: "WATERMARKING 

DIGITAL IMAGES FOR COPYRIGHT PROTECTION" 

I EE PROCEEDINGS: VISION, IMAGE AND SIGNAL 

PROCESSING, 6B, INSTITUTION OF ELECTRICAL 

ENGINEERS, 

vol. 143, no. 4, 

1 August 1996 (1996-08-01). pages 250-256, 
XP000613938 
ISSN: 1350-245X 








* page 252, left-hand column, paragraph 4 
- page 253, left-hand column, line 17 * 




TECHNICAL HELOS 
SEARCHED (InLCLG) 


P. A 


WO 96 36163 A (RHOADS GEOFFREY B ;DIGIMARC 
CORP (US)) 14 November 1996 (1996-11-14) 
* page 83, line 1 - line 35 * 


6,14 




D,P. 
X 


EP 0 766 468 A (NIPPON ELECTRIC CO) 
2 April 1997 (1997-04-02) 

* abstract * 

* column 1, line 3 - column 8, line 12 * 


1.11,18, 
20,22 




D.E 


EP 0 828 372 A (NIPPON ELECTRIC CO) 
11 March 1998 (1998-03-11) 

* abstract * 

* column 3, line 40 - column 8, line 26 * 


1.11.18. 
20,22 




The present search report has been drawn up for all claims 







Place o( search 

THE HAGUE 



Date o( comptetkm ol the search 

27 March 2000 



Examiner 

Fassnacht, C 



CATEGORY OF OfTED DOCUMENTS 

X : partioutariy relevant iT taken atone 

Y : particulartjr relevaM V oombtrMd wUh anothw 

doeumont of th« %sm* category 
A : teohnologioat baokground 
O : non-written dtaolosure 
P : intermediate doeument 



T : theory or prinoipte undeHying the invention 
E : eaHier patent document^ Init published on, or 

after the fBingdote 
D : document cfted in the application 
L : document oited for other r 



& : member of the eome patent famtty, ooneaponding 
dooument 



084051 I > 



3 



THIS PAGE BLANK (uspto) 



